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Abstract 

In 1983, Aldous proved that randomization can speedup local search. For example, it 
reduces the query complexity of local search over [1 : n]'^ from e(n'^-i) to 0{d^^^n'^/^). It 
remains open whether randomization helps fixed-point computation. Inspired by this open 
problem and recent advances on equilibrium computation, we have been fascinated by the 
following question: 

Is a fixed-point or an equilibrium fundamentally harder to find than a local optimum? 

In this paper, we give a nearly-tight bound of (f2 (n))'^ ^ on the randomized query 
complexity for computing a fixed point of a discrete Brouwer function over [1 : n]'^. Since the 
randomized query complexity of global optimization over [1 : n]'^ is Q{n'^), the randomized 
query model over [1 : n]'^ strictly separates these three important search problems: 

Global optimization is harder than fixed-point computation, and 
fixed-point computation is harder than local search. 

Our result indeed demonstrates that randomization does not help much in fixed-point 
computation in the query model; the deterministic complexity of this problem is Q{n'^~^). 
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Prologue 



Scene 1: On the first day of your new job, your boss teaches you the Simplex Algorithm 
with the Steepest-Edge Pivoting Rule. You quickly master the steps of the al- 
gorithm. So she gives you a large linear program that simulates a new business 
model. 

"I am going to a convention in Hawaii for ten days. Could you work on the 
program starting with this initial vector xo?" she asks. "The solution will be 
a vector that you cannot improve upon. Email it to me when you are done" 
So she leaves for beautiful Hawaii a,nd you begin your iterative path-following 
search. Ten days later, she comes back, relaxed, right as you finish computing 

XlOOOOOO 

"/ haven't found the solution yet, " you report, "but I have followed the steepest- 
edges a million steps and get xioooooo • " 

She takes the objective vector c and quickly computes C"^xioooooo/c"^xo, and it 
is 1.10. 

"You find a vector that is 10 percent better than what we had initially," she 

says cheerfully. "Good job!" 

The next day, you get a ten-percent raise. 

Scene 2: On the first day of your new job, your boss teaches you the Lemke-Howson 
algorithm for finding a Nash equilibrium of a two-player game. You quickly 
master the steps of the algorithm. So he gives you a large two-player game 
that models a two-group exchange market. 

"I am going to a convention in Hawaii for ten days. Could you work on 
this two-player game?" he asks. "Here is an initial strategy-profile," he gives 
you (xo,yo), "and the strategy-profile that Lemke-Howson halts on is a Nash 
equilibrium. Email it to me when you are done. " 

So he leaves for beautiful Hawaii and you begin your iterative path-following 
search. Ten days later, he comes back, relaxed, right as you finish computing 

(xiOOOOOO; y 1000000 

"/ haven't found the solution yet, " you report, "but I have followed the Lemke- 
Howson path a million steps and get (xioooooO) Yioooooo)- " 
He looks at (xioooooO) yioooooo) for a while and then frowns, just slightly. 
"Hmmmm, no equilibrium in a million steps!" he says. "Well, good job and 
thanks. " 

The next day, you still have your job but get no raise. 



1 Introduction 



The Simplex Algorithm [TT] is an example of an implementation of local searct0 and finding a 
Nash equilibrium [22] is an example of fixed-point computation (FPC). A general approach for 
local search is Iterative Improvement. Steepest-Descent is its most popular example. It follows a 
path in the feasible space, a path along which the objective values are monotonically improving. 
The end of the path is a local optimum. Like Iterative Improvement, many algorithms for FPC, 
such as the Lemke-Howson algorithm [20] and the constructive proof of Sperner's Lemma [29], 
also follow a path whose endpoint is an equilibrium or a fixed-point. But unlike apath in local 
search, a path in FPC does not have an obvious "locally computable" monotonico measure-of- 
progress. Moreover, path following in FPC from an arbitrary point could lead to a cycle while 
the union of paths in Iterative Improvement is acyclic. 

Do these structural differences have any algorithmic implication? 

There have been increasing evidence, beyond the stories of our prologue, that local search 
and FPC are very different. First, Aldous [2] showed that randomization can speedup local 
search (more discussion below). His method crucially utilizes the monotonicity discussed above. 
It remains open whether randomization helps FPC. Second, polynomial-time path- following- 
like algorithms have been developed for some non-trivial classes of local search problems. These 
algorithms include the interior-point algorithm for linear and convex programming [181 I23j 
and edge-insertion algorithms for geometric optimization |13j . However, popular fixed-point 
problems, such as the computation of a Nash or a market equilibrium [3| might be hard for 
polynomial time [12^ [71 Other than those that can be solved by convex programming, 
we haven't yet discovered a significantly non-trivial class of equilibrium problems that are 
solvable in polynomial-time. Third, an approximate local optimum for every PLS (Polynomial 
Local Search) problem can be found in fully-polynomial time |24j . In contrast, although a faster 
randomized algorithm was found for approximating Nash equilibria [2T] , finding an approximate 
Nash equilibrium in fully-polynomial time is computationally equivalent to finding an exact 
Nash equilibrium in polynomial time [8] . We face the same challenge in approximating market 
equilibria [E]. Fourth, although they all have exponential worst-case complexity [271 fT9] . 
the smoothed complexity of the Simplex Algorithm and Lemke-Howson Algorithm (or Scarf's 
market equilibrium algorithm ^28j) might be drastically different [30^ [H [16]. This evidence 
inspires us to ask: 

Is fixed-point computation fundamentally harder than local search? 

To investigate this question, we consider the complexity of these two search problems defined 
over = [1 : n]"^. For fixed-points, we are given a function F : — > ZJ^ that satisfies 
Brouwer's condition [5] — a set of continuity and boundary conditions (see Section 2) — that 
guarantees the existence of a fixed-point. Recall that a vector v € Z^ is a fixed-point of F if 
^(v) = V. The FPC problem is to find a fixed-point of F. For local optima, we are given a 

^Note that in linear programming, each local optimum is also a global optimum. 

^Each path has a "globally computable" monotonic measure, the number of hops from the start of the path 
to a node. 
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function /i : ^ M. The local search problem is to find a local optimum of h, for example, a 
vector X G such that /i(x) > /i(y), Vy with ||x — y||i < 1. 

For both problems, we consider the query complexity in the query model: The algorithm can 
only access F and h, respectively, by asking queries of the form: "What is F(x)?" and "What 
is /i(x)?". The complexity is measured by the number of queries needed to find a solution. 

There are some similarities between FPC and local search over Zj^. For both, divide-and- 
conquer has positive but limited success: Both problems can be solved by 0{n'^~^) queries 
[5]. An alternative approach to solve both problems is path-following. When following a short 
path, it can be faster than divide-and-conquer. But for both problems, long and winding paths 
are the cause of inefficiency. 

However, there is one prominent difference between a path to a local optimum and a path 
to a fixed point. The values of h along a path to a local optimum are monotonic, serving as 
a measure-of-progress along the path. Aldous [2] used this fact in a randomized algorithm: 
Randomly query points in Z^; let s be the sample point with the largest h value; 

follow a path starting at s. If a path to a local optimum is long, say much longer than d^/^n*^/^, 
then with high probability, the random samples intersect the path and partition it into sub- 
paths, each with expected length ©(d^/^n*^/^). As s has the largest h value, its sub-path is the 
last sub-path of a potentially long path, and we expect its length to be 0{d}^'^n^^'^). So with 
randomization, Aldous reduced the expected query complexity to 0{d}/'^n'^^'^). 

But it remains open whether randomization can reduce the query complexity of FPC over 
Z^. The lack of a measure-of-progress along a path makes it impossible for us to directly use 
Aldous' idea. 

Our Main Result 

The state of our knowledge suggests that FPC might be significantly harder than local search, 
at least in the randomized query model. We have formulated a concrete conjecture stating that 
an expected number of ($1 queries are needed in randomized FPC over Zj^. 

As the main technical result of this paper, we prove that an expected number of (17 {n))'^~^ 
queries are indeed needed. Our lower bound is essentially tighlH, since the deterministic divide- 
and-conquer algorithm in [5] can find a fixed point by querying 0{n'^~^) vectors. In contrast 
to Aldous's result [2], our result demonstrates that randomization does not help much in FPC 
in the query model. It shows that, in the randomized query model over Z^, a fixed-point is 
strictly harder to find than a local optimum! The significant gap between these two problems 
is revealed only in randomized computation. In the deterministic framework, both have query 
complexity Q{n'^~^). 

One can show that the randomized query complexity for finding a global optimum over 
is Q{n'^). So, the randomized query model over strictly separates these three impor- 
tant search problems: 

Global optimization is harder than fixed-point computation, and 
fixed-point computation is harder than local search. 

We anticipate that a similar gap can be obtained in the quantum query model. 
''The constant in £7 in our lower bound depends exponentially on d. See Theorem 12.21 
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Related Work and Technical Contributions 

Our work is also inspired by the lower bound results of Aaronson [T], Santha and Szegedy [26], 
Zhang [33], and Sun and Yao |31j on the randomized and quantum query complexity of local 
search over ZJ^. 

In this paper, we introduce several new techniques to study the complexity of FPC. Instru- 
mental to our analysis, we develop a method to generate hard-to-find random long paths in 
the grid graph over Z^. To achieve our nearly-tight lower bound, these paths must be much 
longer than the random paths constructed in [33^ [SIJ for local search. Our paths has expected 
length (G(n))'^~^ while those random paths for local search have length 0(n'^/^). We also 
develop new techniques for unknoting a self-intersecting path and for realizing a path with a 
Brouwer function. These techniques might be useful on their own in the future algorithmic 
and complexity-theoretic studies of FPC and its applications. 

There are several earlier work on the query complexity of FPC. Hirsch, Papadimitriou and 
Vavasis [15] considered the deterministic query complexity of FPC. They proved a tight Q{n) 
bound for and an Q{n'^~'^) lower bound for Z^. Subsequently, Chen and Deng [5] improved 
this bound to Q{n'^~^) for ZJ^. Recently, Friedl, Ivanyos, Santha, and Verhoeven pjy gave 
a f2(n^/^)-lower bound on the randomized query-complexity of the 2D Sperner problem. Our 
method for unkonting self-intersecting paths can be viewed as an extension of the 2D technique 
of [6] to high dimensions. 

Paper Organization 

In Section 2, we introduce three high-dimensional search problems. In Section 3, we reduce 
one of them, called End-of-a-String, to fixed-point computation over Z^. In Section 4, we give 
a nearly tight bound on the randomized query complexity of End-of-a-String. Together with 
the reduction in Section 3, we obtain our main result on fixed-point computation. 

2 Three High-Dimensional Search Problems 

We will define three search problems. The first one concerns FPC. We introduce the last two 
to help the study of the first one. Below, let E*^ = {±ei, ±62, ie^^} be the set of principle 
unit-vectors in d-dimensions. Let || • || denote || • ||oo- For two vector^ u 7^ v in Z'^, we say 
u < V lexicographically if Uj < Vi and uj = Vj for all 1 < j < i, for some i. 

For each of the three search problems, we will define its mathematical structure, a query 
model for accessing this structure, the search problem itself, and its query complexity. 

2.1 Discrete Brouwer Fixed-Points 

Recall that a vector v € ZJ^ is a fixed-point of a function F from ZJ^ to Z^ if -F(v) = v. A 
function / : ZJ^ — > {0} U E"^ is bounded if /(x) -|- x € Zj^ for all x G ZJ^; v G Zf^^ is a zero point 

*We will use bold lower-case Roman letters such as x, a, bj to denote vectors. Whenever a vector, say a G R" 
is present, its components will be denoted by lower-case Roman letters with subscripts, such as ai, . . . ,a„. So 
entries of hj are . . . , bj,n)- 
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of / if /(v) = 0. Clearly, if -F(x) = x + /(x) for all x G Z^, then v is a fixed point of F iff v 
is a zero point of /. 

Definition 2.1 (Direction Preserving Functions). A function f from S to {0}UE'^ where S C 
Z'^ is direction-preserving z/ |[/(ri) — / (r2)|| < 1 for all pairs ri, r2 G S such that ||ri — r2|[ < 1. 

Following the discrete fixed-point theorem of [IT], we have: For every function / : — > 
{0} U E'^, if / is both bounded and direction-preserving, then there exists v € such that 
/(v) = 0. We refer to a bounded and direction-preserving function / over ZJ^ as a Discrete 
Brouwer function or simply a Brouwer function over Z^. In the query model, one can only 
access / by asking queries of the form: "What is /(r)?" for a query point r E Z^. 

The FPC problem ZP*^ that we will study is as follows: Given a Brouwer function f from 
to {0} U E"^ in the query model, find a zero point of f . Let RQ7p(/) denote the expected 
number of queries needed by the best randomized algorithm to finqj a zero point of /. We let 

RQip(n)= max iRQzp(/)}, 

/: Brouwer function over ZJ^ 

be the randomized query complexity for solving ZP*^. In this paper, we will prove: 

Tlieorem 2.2 (Randomized Query Complexity of Fixed Points). There is a constant c such 
that for all sufficiently large n, 

In contrast, the deterministic query complexity for solving ZP*^ is at most 7n^~^ |5j. The 
Brouwer fixed point problem defined here is computationally equivalent to the fixed problems 
defined in [151 [121 [8]. Thus, our result carries over to these FPC problems. 

2.2 End-of-a-Path in Grid-PPAD Graphs 

The mathematical structure for this search problem is a directed graph G = (y,E). A vertex 
V E V satisfies Euler's condition if Aj{v) = Ao{v) where Aj{v) and Ao{v) are the in-degree 
and the out-degree of v. We start with the following definition motivated by Papadimitriou's 
PPAD class [25]. 

Definition 2.3 (Generalized PPAD Graphs). A directed graph G = {V,E) is a generalized 
PPAD graph if (1) there exists exactly one vertex vs & V with Ao{vs) = Aj{vs) + 1 and 
exactly one vertex vt with Aj{vt) = Ao{vt) + 1- (2) all vertices inV — {vs,vt} satisfy 
Euler's condition and (3) if {vi,V2) is a directed edge in E, then {v2-,vi) E. We refer to vs 
and vt as the starting and ending vertices of G, respectively. 

We call G a PPAD graph if in addition Ai[v), Ao{v) < 1, for all v 

Edges of a PPAD graph form a collection of disjoint directed cycles and a directed path 
from Vs to vt- In this paper, we are interested in a special family of PPAD graphs over Z^. 
A directed graph G = (ZJ^, E) is a generalized grid PPAD-graph over Z^ if it is a generalized 

^One can also change "to find" to "to find, with high probabihty". 
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PPAD graph and the underlying undirected graph of G is a subgraph of the grid graph defined 
over Z^. Moreover, if G is also a PPAD graph, then we say G is a grid PPAD graph. 
We now define the query model for accessing a grid PPAD graph G. 

Definition 2.4 (Be). B^ is a map from to ({ "no"} U E'^) x ({ "no"} U E'^) such that, for 



• Bg(v) = ( "no", vi — v) z/v is the starting vertex of G and (v, vi) G E; 

• Bg(v) = (v — vi, "no") if V is the ending vertex of G and (vi, v) S E; 

• Bg(v) = (v — vi, V2 — v) if (vi, v) and (v, V2) are directed edges of G. 

• Bg(v) = ( "no", "no"), otherwise. 

In other words. Be specifies the predecessor and successor of each vertex v in G. We will 
use the property that if Bg(v) = (si, S2) and si, S2 € E'^, then si + S2 7^ 0. 

Let GP'^ be the search problem: Given a triple (G, 0"',u), where G is a grid PPAD graph 
over accessible by Mq and u is the starting vertex of graph G satisfying Ud = 1, find its 
ending vertex. We use RQgp(n) to denote the randomized query complexity for solving this 



2.3 End-of-a-String 

Suppose S is a finite set. A string S over S of length m is a sequence S = aia2...am-iam with 
aj G S. We use \S\ = m to denote the length of S. 

Definition 2.5 (Non-Repeating-Strings). A string S = 0102. ..flm over Z„ = [1 : n] is d-non- 
repeating for d E [1 : m], if (1) each string over Z„ of length d appears in S at most once; (2) 
ai is odd if i is a multiple of d and Oj is even otherwise; and (3) m is a multiple of d. We 
define endd (S) = am~d+i---am- 

Each d-non-repeating string S = ai...am over Z„ defines a query oracle B5 from Z^ to 
({"no"} U Zn) X ({"no"} U Z„): For S' = bib2...bd G Z^, if S' is not a substring of S, then 
'Rs{S') = ("no", "no"); otherwise, there is a unique k such that a^+i-i = 6j, V i G [1 : d]. Then 
BsiS') = ("no",ad+i) if A: = 1, Ms{S') = {om-d, "no") ifk = m-d+l, i.e., S' = en(id{S), and 
Ms{S') = (afc_i,afc+rf), otherwise. 

Let ES*^ be the search problem: Given a d-non-repeating string S over Z„ accessible by 
Ms, and its first d symbols aia2...ad where Ud = 1, find endd{S). We let RQes('^) denote its 
randomized query complexity. It is easy to show that RQEs(n) = Q{n). In section HJ we will 
prove 

Theorem 2.6 (Complexity of ES'^). For all sufficiently large n. 



all V G Zf! 



problem. 
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3 Reduction Among Search Problems 

In this section, we reduce ES'^^^ to ZP'^ by first reducing ES'^^^ to GP'^ (Theorem O below) 
and then reducing GP'^ to ZP'^ (Theorem I3.2p . Theorem 12.21 then follows from Theorem 12.61 

Theorem 3.1 (From ES'^"^ to GP''). For all d>2, RQ^s^(n) < Ad ■ RQ^p(8n + 1). 

Theorem 3.2 (From GP'' to ZP*^). For all d>l, RQQp{n) < RQ^p(24n + 7). 

3.1 From ES'^"^ to GP'^: Proof of Theorem SU 

Proof, [of Theorem 13. Ij : We define a map J^d from Z"'^^ to Z"': for d = 2, J-2{a) = (a, a); and 
for d > 2, JF^(a) = (ai,ai + 02, ...,ad-2 + ad-i,o-d-i)- We will crucially use the following nice 
property of J^d- 

For any k ^ [1 : d\ and for any a € Z'^"^, we can uniquely determine the first k and 
the last k entries of a, respectively, from the first k and the last k entries of .Fd(a). 

Let S" be a (d— l)-non-repeating string over Z„ of length m{d—l) for some m > 2, whose (d— 1)^* 
symbol is 1. We view 5 as a sequence of m points ai, a2, ...3^ in ZJ^"^, where a, = ai^i...ai^d-i, 
such that, 5 = ai^iai^2---o-i,d-i---0'm,iO'm,2---o-m,d-i- From S, we will construct a grid PPAD 
graph G' in two stages. In the first stage, we construct a generalized grid PPAD graph G* over 
such that 

(A.l) Its starting vertex is u* = J^di^i) ^-nd its ending vertex is w* = J^di^m)', 

(A. 2) For every directed edge (u, v) with u — v G E*^, at most one query to 185 is needed 
to determine whether (u, v) € G* . 

Recall that a directed path is simple if it contains each vertex at most once. Suppose u, v € 
are two vertices that differ in only one coordinate, say the i^^ coordinate. Suppose e = (v — 
VL)/\vi — Ui\ £ E'^. Let E{u, v) = {(u, u + e), (u + e, u + 2e), (v — e, v)}. For n, mi, m2 € Z 
and s G {il}) {_n,s) is consistent with (mi, 7712) if either mi < n < m2 and s = +1 or 
m2 < n < mi and s = —1. 

We consider two consecutive points a = a^ and b = a^+i in the {d — l)-non-repeating 
string S. We know a 7^ b. We map them to vertices u = ^-^(a) and w = J-d{h) in and 
connect them with a path through a sequence of {d — 1) vertices vq = u, vi, ...,Vd-i,y^d = w 
where Vij = Uj ii i < j and Vij = wj ii i > j. Note that Vj_i and Vj differ only in the i^^ 
coordinate. Let P(a, b) = ufll^E (vj, Vj+i). Then P(a, b) is a simple directed path in the grid 
graph over Z2„ from u = vq to w = v^^. As S is {d — l)-non-repeating, ai 7^ a^- By Property 
ESI Proposition Ea and Lemma ESI below, G* = (Z^„ , U^7^P(ai, a^+i)) is a generalized grid 
PPAD graph. See Figure [1] for an example. 

Proposition 3.3 (Path Union). Let Pi, P2, Pm be m simple directed paths over V such 
that (1) each path has length at least one, (2) the ending vertex of Pi is same as the starting 
vertex o/Pj+i, (3) the starting vertex of Pi is different from the ending vertex of Pm, and (4) if 
{u, v) € Pi, then {u, v), {v, u) ^ Pj, Vj 7^ i. Then G = {V, U'^^Pi) is a generalized PPAD graph. 
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Figure 1: Graph G* and G' constructed from string 1537 

Proposition 3.4 (Local Characterization of P(a, b)). For v € and s G {±1}, 

1. (v,v + sei) e P(a, b) i/ and onZy i/ is consistent with (ai,6i), a^-i = u^, and 
Od-i = Vd-i+i - ffld-j+i for all 2 < i < d - 1; 

2. (v, V + se^) € P(a, b) if and only if (i^rf, s) is consistent with {ad-ijbd-i), bi = vi, and 
bi = Vi — bi-i, for 2 < i < d — 1; and 

3. for 1 < k < d, (v,v + se^) € P(a, b) if and only if {vk,s) is consistent with {ok-i + 
ak,bk-i + and (3.1) ad-i = v^, and ad-i = t'd-i+i — Od-i+i for 2 < i < d — k and 
(3.2) 6i = vi, and bi = Vi — 6j_i for 2 < i < k — 1. 

Lemma 3.5 (Structural Correctness). For all (d— 1) -non-repeating string S = aia2...am over 
TLn, if {u,v) G P(aj,aj+i) then (u,v),(v,u) ^ P(aj,aj+i) for alii ^ j. 

Proof. We only prove the case when e = v — u = se^ with 1 < k < d and s S {il}- The other 
two cases are similar. From Proposition l3.4l (u, v) E -P(aj, aj+i) implies that a^ and aj+i satisfy 
conditions (3.1) and (3.2). If (u, v) or (v, u) is in P(aj, aj+i), then aj and aj+i also satisfy these 

two conditions. Then ai^kai^k+i---ai,d-iai+i^i...ai+i^k-i = aj^kaj^k+i---aj,d-iaj+i,i---aj+i,k-i, 
which contradicts with the assumption that S" is (d — l)-non-repeating. □ 

We prove Property A. 2 as follows. 

Proof of Property A. 2. We will only prove for the case when e = v — u = se^ with 1 < k 
< d. The other two cases are similar and simpler. To determine whether (u, v) € G* or 
not, we consider the string 5' = akak+i---ad-ibi...bk-i that satisfies both (3.1) and (3.2) in 
Proposition [331 Edge (u, v) G G* if and only if 1) 5' G 2) Od-i is odd; 3) 185(5') = (a, 6) 

for some a, 6 G and 4) (u^, s) is consistent with (a + a^, bk-i + b), So, only one query to Ms 
is needed. □ 

In the second stage, we construct a grid PPAD graph G' over "^gn+i from graph G*. Let 
r(v) = 4v — 1 for all v G 1^2^- Our G' will satisfy the following two properties. See Figured] 
for an example. 

(B.l) Its starting vertex is u' = r(u*) — 20,^; its ending vertex w' satisfies ||w' — r(w*)|| < 1; 

(B.2) For each v G Zg„_,_]^, one can determine from the predecessors and successors 

of u in G*, where u is the lexicographically smallest vertex such that ||v — r(u) < 2||. 
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Graph G[Hi,H2], where {Hi,H2) is a balanced-non-cancehng pair 



1 : set edge set E[Hi,H2] = 
2 : while i?i / do 

3 : let si be the smallest vector in Hi and S2 be the largest vector in H2 

according to the lexicographical ordering; 
4 : set Hi = Hi - {si} and H2 = H2 - {s2 }; 

5: set E[Hi,H2] = i/a] U { (0 - si, - si + 83), (0 - si + sa, + sa) } 



Figure 2: Construction of Graph G[Hi,H2] = {{-1,0, +1^ , E[Hi, H2]) 

Two subsets Hi and H2 of E'^, where d>2, form a balanced-non- canceling pairii \Hi\ = li^al 
and si + S2 / for all si G Hi and sa G i/a- Let i//(u) = {e G E'' | (u - e, u) G } be the 
vector differences of u and its predecessors in G* . Similarly, let Ho{u) = {e G E'^ | (u, u + e) G 
E* } be the vector differences of the successors of u and u. In the construction below, we will 
use the fact that if u satisfies Euler's condition then {Hj, Hq) is a balanced-non-canceling pair. 

Using the procedure of Figure EJ we build a graph G[Hi,H2] = {{ — l,0,+\Y,E[Hi,H2]) 
for each balanced-non-canceling pair Hi and ifa- G[Hi,H2\ has the following properties: (1) 
For every u G {-1, 0, -hi}'', A/(u),Ao(u) < 1; (2) A vector u G {-1,0, -hl}'^ has A/(u) = 
and Ao(u) = 1 iff there exists an e G i?i such that u = — e; (3) A vector u G {—1,0, -1-1}°' 
has A/(u) = 1 and Ao(u) = iff there exists an e G H2 such that u = -|- e. 

Let u* be the starting vertex and w* be the ending vertex of G* . We build a grid PPAD 
graph G' = (Zg„_^]^, i^') by applying the procedure of Fig. [2] locally to every vertex u G of 
G* . We use {Hi{m),Ho{'vC)) or a slight modification of (///(u), ffo(u)) when u = u* or w*. 
Initially we set E' = 0. Recall r(u) = 4u - 1. 

1. [local embedding of the starting vertex] Since u*^ = 1, we have e^^ ^ Hj{u*) and 
-ed i Ho{u*). Let Hj = Hi{u*) U {e^}. We add edges (r(u*) - 2ed,T{u*) - e^) and 
(r(u*) + si,r(u*) + S2) to E' for ah edges (si,S2) in G[Hi, Ho{u*)]. 

2. [local embedding of the ending vertex] As \Hi{w*)\ = \Ho{y^*)\ + 1, Hj{w*) 7^ 0. 
Let e be the smallest vector in Hi{w*), and Hj = Hi{w*) - {e}. Add edges (r(w*) + 
si,r(w*) -hsa) to E' for ah edges (si,sa) in G[Hi, Ho{v^*)]. 

3. [local embedding of other vertices] For each u G G*, add (r(u) -|- si,r(u) -|- sa) to 
E' for ah edges (si,S2) in G[Hi{u), Ho{u)]. 

4. [connecting local embeddings] For each edge (u,v) G G*, let e = v — u G E'^. We 
add (r(u) + e, r(u) + 2e) and (r(u) + 2e, r(u) + 3e) to E'. 

It is quite mechanical to check that G' is a PPAD grid graph that satisfies both Property B.l 
and B.2. We therefore complete the proof of Theorem 13.11 □ 
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3.2 Canonicalization of Grid-PPAD Graphs 

To ease our reduction from a grid-PPAD graph to a Brouwer function, we first canonicalize the 
grid-PPAD graph by regulating the way its path starts, moves, and ends. 

Definition 3.6 (Canonical Grid-PPAD Graphs). A grid-PPAD graph G over for d > 2 
and n > 1 is canonical ifMo satisfies Mq{u) E S'^ for all u E Z^, where 

52 = {{"no", "no"), {"no", 62), ie2, "no")} U { (si, S2) | si, S2 E E^, si + S2 O}. 

For d>3, S'^ is the smallest subset of ({ "no"} U E"') x ({ "no"} U E'^) that satisfies: 

1. ( "no", "no"), ( "no",ed), (e^, "no") E 5^- 

2. {ed} X {ed_i,erf} C S'^ and {-e^} x {ed-i,-ed} C S'^; 

3. {efe} X {efc_i,efc,±efc+i} C S'^ and {-e^.} x {efc_i,-efc} C S'^ , for 3 < k < d; 

4. {62} x {±ei,e2, ibes} C S'^ and {-62} x {±ei,-e2} C 5'^; 

5. {ei} X {ei,±e2} C S'^; and {-ei} x {-ei,±e2} C S'^. 

Informally, edges in a canonical grid-PPAD graph over contains a single directed path 
starting at a point u E with Ud = I and ending at a point, say w, and possibly some cycles. 
The second vertex on the path is u + and the second-to-the-last vertex is w — e^. The path 
and the cycles satisfy the following conditions (below we will abuse "path" for both "path" and 
"cycle"): (1) To follow a directed edge along e/j (for k > 3), the path can only move locally in a 
3D framework defined by {efc_i, e^, ±ek+i}, see FigureEl (for A; = d, it can only move in a 2D 
framework). In a way, we view the d-dimensional space as a nested "affine subspaces" defined 
by {ibei, zbe^} for 1 < k < d. So to follow a positive principle direction e^, the path can 
move down a dimension along the positive direction efc_i, stay continuously along e^, or move 
up a dimension (unless k = d) along either itefc+i. (2) To follow a directed edge along — for 
k > 3, the path can only move locally in a 2D framework defined by {efc_i, — e^}, see Figure [3l 
The path can move down a dimension along the positive direction of efc_i or stay continuously 
along —ek, but it is not allowed to move up or leave this fc-dimensional "affine subspace". In 
the {ibei,ibe2} framework, the path is less restrictive as defined by conditions 4 and 5. 




Figure 3: 

In other words, the path can not move-up from an "affine subspace" (with the exception of 
the ibei space) without first taking a step along the highest positive principle direction in the 
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subspace. Similarly, the path can only move-down to an "affine subspace" by taking a positive 
first step along its highest principle direction. Otherwise, the path moves continuously. 

Let CGP'' be: Given a triple (G, 0",u*) where G is a canonical grid-PPAD graph over 
accessible by Mq and u* is the starting vertex of G with -u^ = 1, find the ending vertex of G. 
We use RQcGpl'^) to denote the randomized query complexity for solving this problem. 

We now reduce GP*^ to CGP'^. Before stating and proving this result, we first give two 
geometric lemmas. They provide the local operations for canonicalization. 

We start with some notation. A sequence P = Ui...Um, for m > 2, is a canonical local path 
if Uj's are distinct elements from {—3, —2, +2, +3}'^ and (uj — Uj_i, Uj+i — Uj) G S'^ for all 
2 < i < m — 1. Suppose P = uiU2...Um and Q = viV2...v,t are two paths with Um = vi. We 
use PoQ to denote their "concatenation": PoQ = uiU2...UmV2...Vfc. 

Lemma 3.7 (Ending Gracefully). For each s G E'^ with d > 2, there is a canonical local path 
P[d,s\ = ui...Um, satisfying u^ — Um,-i = e^, ui = —3s, U2 = —2s, and\/ i G [2 : m], \\ui\\ < 2. 

Proof. We consider the three cases: s = e/ for 1 < / < d, s = — ei and s = — e; for 2 < I < d. 

In the first case, we set P[d,s] = uiU2...Urf_;+2 where ui = — 3e;, U2 = — 2e; and Uj = 
Uj-i + e;+i_2 for 3 < z < d — Z + 2. In the second case, we set P[cZ, s] = uiU2...UdUd+i 
where Ui = 3ei, U2 = 2ei and Uj = Uj_i + e^-i for 3 < i < d + 1. In the third case, we 
set P[d,s\ = uiU2...Ud-i+5 where Ui = 3e;, U2 = 2e/, U3 = e; and Uj = Ui_i + ei+i-5 for 
4<i <d-l + 5. 

One can easily check that P[d, s] satisfies the conditions of the lemma. □ 

Lemma 3.8 (Moving Gracefully). For all Si,S2 G E*^ with d>2 such that si + S2 7^ 0, there 
exists a canonical local path P[d, 81,82] = UiU2...u^_iUto that satisfies Ui = — 38i, U2 = — 28i, 
Um-i = 2s2, = 382, and V i G [2 : m — 1], ||uj|| < 2. 

Proof. We prove by induction on d that there is a canonical local path P[d, si, 82] such that 

1. 81,82] satisfies all the conditions in the statement of the lemma; 

2. For all Si, 82 G such that 81 + 82 7^ 0, e^, — ^ P[d, 81, 82]; and 

3. If 81 = — e^, then the first 3 vertices of P[d, —6^,82] arc 36^, 2ef| and (e^-i + 2ed). If 
82 = — e^, then the last 3 vertices of P[d, si, — e^] are (— e^-i — 2ed), —2e(i and —Sed. 

The base case when d = 2 is trivial. Inductively we assume, for 2 < d' < d, path P[d' ,s'^,S2] 
exists for all 8'j^,82 G E'^ such that 8'j^ + 83 / 0. We let s'j^, 83] denote the sub-path of 

P[d',8'^,82] such that 

P[d',s'i,s'2] = (-3s'i)(-2s'i) o P'K,s'i,8'2] O (2S^)(38'2). 

Note that P'[d', s'^, 83] starts with —28'^ and ends with +282. 

Wc will use D to denote the map D{r) = (ri, ...,rd_i) from Z"' to Ij'^^^ and U to denote 
the map U{r) = (ri, ...,rd-i,0) from Z'^"^ to Z'^. For a canonical local path P = ui...Um in 
{-3,..., +3}'^-^, we use U{P) to denote path U{ui)U{u2)...U{um) in {-3, -^3}''. 
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For si, S2 G E"^ with si + S2 7^ 0, we use the following procedure to build P[d, 81,82]. Let 

P+ = (-Serf) (-2erf) (erf_i - le^) {ea-i - e^) (ea-i) {2ea-i); 

P~ = (Serf) (2erf) (erf_i + 2erf) (erf_i + erf) (erf_i) (2erf_i); 

= (-2erf_i) (-erf_i) (-erf_i + erf) (-erf_i + 2erf) (2erf) (Serf); 

= (-2erf_i) (-erf_i) (-erf_i - erf) (-erf_i - 2erf) (-2erf) (-Serf). 

1. If 81 ^ {±erf}, then set P = (-38i)(-2si) and s'^ = D{si); 

Set P = P^ and s'^ = — erf_i if 81 = erf and P = P~ and s'^ = — erf_i if 81 = —erf; 

2. If 82 ^ {±erf}, then set Q = (282) (S82) and s'2 = D{s2); 

Set Q = and = — erf_i if 82 = erf and Q = Q~ and 83 = — erf_i if S2 = —erf; 

3. Set 81,82] = Po U{P'[d -l,s[,s'2]) o Q: 

One can check that 81,82] satisfies all three conditions of the inductive statement. □ 

Theorem 3.9 (Canonicalization). For all d>2, RQGp(n) < RQcGp(6n + 1). 

Proof. Let r(u) = 6u — 2 be a map from Z'^ to Z'^. Given any grid-PPAD graph G* over Z^, 
we now use the canonical local paths provided in Lemmas IS. 71 and IS. 81 to build a canonical 
grid-PPAD graph G = (Zg„_^]^, E). In the procedure below, initially E = %: 

1. [ canonicalizing the 8tarting vertex]: Let u* be the starting vertex of G*. Suppose 
]Bg*(u*) = ("no", 8). As u*^ = 1, we have 8 7^ —erf. For every edge (vi,V2) appears in 
path P[(i,erf,8], add (r(u*) + vi, r(u*) + vg) to E; 

2. [canonicalizing the ending vertex]: Let w* be the ending vertex of G* . Suppose 
Bg.(w*) = (s, "no"). For every (vi,V2) in P[d,s\, add (r(w*) + vi,r(w*) + V2) to E; 

S. [canonicalizing other vertices]: For all u G ZJ^ — {u*,w*}, if Bg*(u) = (81,82) and 
81,82 / "no", then add (r(u) -|-vi,r(u) + V2) to E for every edge (vi,V2) in ^[(i, si, 82]. 

By Lemmas IS. 7| IS. 81 and the procedure above, G = (Zg^^^jE') is a canonical grid-PPAD graph 
that satisfies the following two properties, from which Theorem IS. 91 follows. 

(C.l) The starting vertex of G is r(u*) — Serf, and the ending vertex w of G satisfies 

llw-r(w*)i| < 2. 

(C.2) For every vertex v G G, to determine Mq{-v), one only need to know Bg*(u) where 
u is the lexicographically smallest vertex in ZJ^ such that JJv — r(u)]| < S. |— | 

3.3 From CGP'^ to ZP'^: Complete the Proof of Theorem [311 

Now we reduce CGP°' to ZP"^. The main task of this section is to, given a canonical grid- 
PPAD graph G = {Zf^,E) and its starting vertex u*, construct a discrete Brouwer function 
fc : — {0} U E"' that satisfies the following two properties: 
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(D.l) fa has exactly one zero point r*, and ^'"^(r*) is the ending vertex of G, and 
(D.2) For each r G '^'in+21 most one query to Bq is needed to evaluate /g, 
where *(u) = 4u is a map from to Immediately from these properties, we have 

Theorem 3.10 (From CGP"' to ZP'^). For all d>2, RQcgp(") < RQzp(4n + 2). 

Local Geometry of Canonical Grid PPAD Graphs 

To construct a Brouwer function from G = {7J^,E), we define a set Iq C Z4„^2) which looks 
like a collection of pipes, to embed and insulate the component of G. Xq has two parts, a 
kernel K,g and a boundary Bq- We will first construct a direction-preserving function on 
Bq- We then extend the function onto Z4„_|_2 to define /g- In our presentation, we will only 
use u,v,w to denote vertices in and use p,q, r to denote points in Ul^^j^2- L^t u and v be 
two vertices in with u — v € E'^. We abuse 'I'(uv) to denote the set of five integer points 
on line segment ^'(u)^'(v). Let u* and w* be the starting and ending vertices of G. We define 

= (U(vi,v,)eE *(viV2)) U { *(u*) - ed, *(w*) + e, }, 

= { r ^ /Cg I 3 r' G U(vi,v.)eE *(viV2), ||r - r'|| = 1 }, 

and Xg = U Bq- For u G Z^, we use to denote {r G Zf^_^2' Ik " < 2}. As the 

local structure of Bq n depends only on Bg(u), we introduce the following definitions. 

Definition 3.11 (Local Kernel and Boundary). For each pair tt = (si,S2) G S*^ with d > 2, 
let }Cd,77 cind Bd,T: be two subsets of ^^_2 2] = —1, 0, 1, 2}'^, such that 

1. if si = S2 = "no", then ICd,-^ = Bd,-^ = 0; 

2. if Si = "no" and S2 7^ "no" (s2 = e^), then Kd^n = {—^d^^^^di'^^d} o-nd 

Bd,^ = { r G Zf_2_2] - JCd,^ I 3 r' G {0, e^, 2ed }, ||r - r'|| = 1 }; 

3- if Si ^ "no" and S2 = "no" (si = e^), then Kd^-n = {—^^d, — ©^,0, e^} and 

Bd,n = { r G Zf_2,2] - ICd,n I 3 r' G {-2ed, -e^, 0}, ||r - r'|| = 1 }; 

4- otherwise, K,d,TT = {— 2si, — si, 0, S2, 2s2} and 

Bd,n = { r G Zf_2_2] - ICd,n I 3 r' G JCd,^, ||r - r'|| = 1 }. 

For r G Z'^ and set 5 C Z<^, let r + S = {r + r',r' e S}. We will use the fact that for all 
u G Z^, if TT = Bg(u), then /Cg fl Cu = *(u) + ]Cd,-j: and Hg fl Cu = *(u) + 5^,^. 
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Figure 4: f2,n, /2,+ and /2,- 



The Construction of Brouwer Function 

First, we define two direction-preserving functions fd,+ ,fd,- from Bd to ¥,'^ for d > 2, where 
Bd = {—1,0,1}'^ — 0: For every r G Bd, letting k be the smaUest integer such that 7^ 0, 
fd,+ {r) = /d-(r) = -rfcCfc ifl<A;<d-l and fd,+ {r) = -VdGd, fd-{r) = TdGd, otherwise. 
Using these two functions, we inductively build a (direction-preserving) function /^-n- on Bd^n 
for each vr = (81,82) S S'^. See Figured] for the complete construction for d = 2. Informally, if 
r G B2,7r is on the left side of the "local" path, then /2,7r(r) = — ei, otherwise it equals ei. 

For d > 3, the construction is more complex but relatively procedural^. Below, we use D 
to denote the map D{r) = (ri, r2, rd-i) from Z'^ to Z"^"^ and Uk to denote the map Uk{r) = 
(ri, r2, r^-i, fe) from Z*^"^ to Z''; we also extends it to sets, that is, Uk{S) = {Uk{r),r G 5} 
for 5 C Z'^-K Let S[k] = {reS,rd = k} for 5 C Z"'. 

1. Moving w^ithin (d-l)-dimensional space: 

When TT = (81,82) satisfies vr' = {D{si), D{s2)) G 5*^^^, Bd^jr can be decomposed into 

{U-i{Bd-iy) U ?7_i(/Cd-i,.0) U Uo{Bd-iy) U (C/i(Sd-i,.0 U C/i(/Cd_i,^0) • 

We set fdAr) = Uo{fd-iy{D{r))) for r G U-,{Bd-iy) U Uo{Bd-iy) U [/i(Sd-ix)- 
We set fd,Tr{r) = -Gd-i for r G U-i{ICd-iy) and /d,,r(r) = e^-i for r G Ui{)Cd-iy). 

2. Moving along =be^: In this case, we will use the fact D{r) G Bd-i, for all r G Bd^n- 
When vr = {ed,ed), ("no",ed) or (e^, "no"), /d,^(r) = Uoifd-i,+{D{r))) for all r G Bd,^- 
When vr = (-e^, -e^), we set fd,A^) = Uo{fd-i-{D{r))) for ah r G S^.tt- 

3. Moving between e^_i and ite^: 

(a) When vr = (81,82) = {ed-i,ed), let vr' = (-D(si), "no") G S'^'K We have 

BdA'^] = U2il3d-i), Bd,AM = UiiBd-iy U fCd-iy) - {e^}, ^^,^[-2] = 0, 
BdAO] = Uo{Bd-iy) U {ed_i}, ^^,.[-1] = U-i{Bd-iy U ICd-iy). 

We set fdA^) = Uo{fd-i,+ {D{r))) for r G ^^,,[2]; 
^Sorry for so many cases. You will find that they are progressively easier to understand. 
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Figure 5: /s,^ where vr = (e^.i, e^), (-e^, e^^i), (e^-i, -e^) and {ed,ed-i) 



fdA^) = Uo{fd^iy{D{v))) for r G Ui{Bd-iy) U [/o(^d-ix) U U.i{Bd-iy); 
fdA^d-i + ed) = fdA^d-i) = -e^-i; fdA^) = -^d-i for r e C/-i(/Crf_i^^/); 
/d,7r(r) = Gd-i for r G Ui{lCd-iy) - {ed^f^d-i + e^}. 

(b) When vr = (si,S2) = (-erf,erf_i), let vr' = ("no",L>(s2)) G 5^^-^ We have 

Bd,^[-2] = 0, Srf,,[2] = U2{Bd-i), Bd,^[l] = Ui{Bd-iy U ICd-iy) - {e^}, 
^^,.[0] = Uo{Bd-iy ) U {-erf_i}, ^^,^[-1] = U-i{Bd-iy U /Cd_ix). 
We set fd,Ar) = Uo{fd^i,-{D{r))) for r G ^^,^[2]; 

A.(r) = ?7o(/d-ix(^W)) for r G Ui{Bd-iy) U [/o(^?d-ix) U C/-i(erf_i,^0; 
/d,7r(r) = -Gd-i for r G C/_i(/Crf_i,^'); fd,n{-ed-i + e^) = fd,ni-ed-i) = -e^^i; 
/d,7r(r) = ed_i for r G f/i(/Cd_i,^/) - {-e^^i + 6^,6^}. 

(c) When vr = (si,S2) = {ed-i, -e^), let tt' = {D{si), "no") G S'^-^. We have 

^rf,,[2] = 0, BdAM = Ui{Bd-iyUlCd-iy), Bd,AO] = Uo{Bd-iy) U {e^^i}, 
BdA-^] = U-i{Bd-iy U JCd^iy) - {-ed}, Bd^-'A = U-2{Bd-i). 
We set fdA^) = C/o(/d-i,-(D(r))) for r G ^d,.[-2]; 
fdA^) = Uo{fd-iy{D{r))) for r G Ui{Bd^^y) U UoiBd-iy) U 
/d,7r(r) = ed-1 for r G C/i(/Cd_i,^/); fdA^d^i) = fdA^d-i - ^d) = e^-i; 
/d,7r(r) = -erf_i for r G U-i{lCd-iy) - {-erf,erf_i - e^}. 

(d) When vr = (si,S2) = (ed,ed_i), let tt' = ("no" , L»(s2)) G S'^-^ . We have 

^rf,,[2] = 0, BdA^\ = UiiBd-iy U }Cd-iy), Bd,nM = Uo{Bd^iy) U {-ed-i}, 
BdA-'^] = U-i{Bd-iy U ICd^iy) - {-erf}, ^^,,[-2] = U.2{Bd-i). 
We set /rf,^(r) = Uo{fd-i,+ {D{r))) for r G ^d,.[-2]; 

fdA^) = Uo{fd-iy{D{r))) for r G Ui{Bd-iy) U [/o(^d™ix) U [/_i(Srf_i,^0; 
A7r(r) = e^^i for r G C/i(/Crf_i,^/); /d,7r(-ed_i) = /d,7r(-ed-i - e^) = e^.i; 
A7r(r) = -e^-i for r G U-iiKd-iy)) - {-e^, -erf_i - e^}. 
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fair), where r G Z|„+2 



1 : let u* and w* be the starting and ending vertices of G, p* = ^(u*) and q* = ^'(w*) 

2: if rd = 1 or 2, and D{r) = D{p*) then /G(r) = e^ 

3: else if = 1 or 2, and |l-C>(r) - D{p*)\\ = 1 then 

4: let A: denote the smallest integer such that 7^ r^, fci^) = {Pk ~ i^k)^k 

5: else if r = q* then fci^) = 

6 : else if r = q* + e^ then /G(r) = —^d 

7: else if r G ICq then /G(r) = ^d 

8: else if r € then /G(r) = /'^(r) 

9: else if = 1 (and ||L>(r) - D{p*)\\ > 2) then 
10: let k denote the smallest integer such that / r^, /G(r) = sign(p^ — rk)ek 

11: else /G(r) = -e^ 



Figure 6: Construction of Function /g from /' 



Lemma 3.12 (Locally Directional Preserving). For every vr € S'^, fd^w is direction-preserving 
on Bd,n- 

Proof. We prove the lemma by induction on d. The base case when d = 2 is trivial. We now 
consider the case when d > 2 and assume inductively that the statement is true for d — 1. 

First, vr = {e(i,ed), ("no",ed), (e^, "no") or (— e^, — e^). The statement follows from the 
fact that fd-i,+ and fd-i- are direction-preserving on Bd-i- Second, vr = (si,S2) satisfies 
vr' = (L>(si), D(s2)) € S'^^^. By the inductive hypothesis, fd-iy is direction-preserving, from 
which the statement follows. Third, tt = {ed-i,ed), {ed-i, — e^), {—ed,ed-i) or {ed,ed-i). One 
can prove the following statement by induction on d. 

For TTi = ("no",ed) and 7r2 = (e^, "no"), Bd^^ n 5^ = Bd,n2 n Bd = Bd - {-ed,ed}. 
Moreover for each r e Bd - {-ed,ed}, /d,7ri(r) = /<i,7r2(r) = fd,+{r) = fd-{r). 

To show fd^TT is direction-preserving on Bd^n, it suffices to check ||ri — r2|| > 1, for all pairs 
ri, r2 G Bd,n such that/d,7r(ri) = ed-i and fd,nir2) = -^d-i- □ 

With these local functions fd^n, we can build a global function f'^ from Be to {zbei,..., 
±erf_i} as following: for every r G Bg, we set f^{r) = /d,7r(r — ^(u)), where u is the lexico- 
graphically smallest vertex in ZJ^ such that r G Cu and vr = ]Bg(u), 

Lemma 3.13. For every canonical grid PPAD graph G overZ,'^, /*-' is direction-preserving on 
set Bg- 

Proof. By Lemma [3. 121 it suffices to prove the following: For r G Bg, if r G Cu H Cv where u, 
V G Z^, then fd,^,{r - ^'(u)) = /rf,,,(r - ^(v)), where m = Bg(u) and 7:2 = Bg(v). We will 
use the fact that s = u — v G and either (u, v) G G or (v, u) G G. 
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For S <ZU^ and p € Z*^, we use 5 + p to denote {r G Z"^ | r = r' + p, r' S S}. The lemma 
is a direct consequence of the following statement which can be proved by induction on d. 

For all s = foe^ G E'' with h G {±1} and A; G [1 : d], if vri = (si,s) G S"^ and 
7r2 = (s,S2) G 5"^ then {r G B^^^^.r^ = 26} = {r G Bd,n2,rk = -26} + 4s, and for 
every r in the former set, fd,niir) = /d,7r2(r - 4s). □ 

Finally, to extend f'^ onto *° define our function /g, we apply the procedure given 

in Fig.m It is somewhat tedious but procedural to check that fc satisfies both Property D.2 
and D.l stated at the beginning of this subsection. 

4 Randomized Lower Bound for ES*^ 

The technical objective of this section is to construct a distribution S of non-repeating strings 
and show that, for a random string S drawn according to S, every deterministic algorithm for 
ES*^ needs expected (r2(n))°' queries to 185. Thus, by Yao's Minimax Principle [32], we have 
RQesW = {^{n)Y. Our main Theorem 12.21 then follows from Theorems 13.11 and 13. 2i 

We apply random permutations hierarchically to define distribution S to ensure that a 
random string from S has sufficient entropy that its search problem is expected to be difficult. 
The use the hierarchical structure guarantees that each string in S is d-non-repeating. 

4.1 Hierarchical Construction of Random d-Non- Repeating Strings 

We first define our hierarchical framework. Let J„ = [2 : 2n + 2], 0„ = {3,5, ...,2n + 1} and 
F„ = {4,6, ...,2n + 2}. Let 5o = 2, S*! = 3 o 4, 5„ = (2n + 1) o (2n + 2). Each permutation vr 
from [1 : n] to [1 : n] defines a string C = Sqo 5,^(1) o • • • o which we refer to as a connector 
over In- 

Let r[C] = 27r(n) + 2, the last symbol of C. We use (pcC^) to denote the right neighbor of 
2. Each s G Jn — {2,r[C7r]} has two neighbors in C. The left neighbor of an even s is s — 1, 
we use (pcis) to denote its right neighbor; the right neighbor of an odd s is s + 1, and we use 
(pc{s) to denote its left neighbor. Clearly, if (j)c{s) = t then (pdt) = s. 

Our hierarchical framework is built on T^^di the rooted complete-(2n + l)-nary tree of height 
d. In Tn^di each internal node u is connected to its (2n + 1) children by edges with distinct 
labels from JI„; if u is connected to v by an edge labeled with j, then we call v the j'^^ -successor 
of u. Each node v of T^^d has a natural name, name (f ), the concatenation of labels along the 
path from the root of Tn^d to v. Let height (v) and level (v) denote the height and level of node 
V in the tree. For example, the height of the root is d and the level of the root is 0. 

Definition 4.1 (Tree-of-Connectors). An (n,d)-ToC T is a tree T^^d in which each internal 
node V is associated with a connector over Sn- The r[CvY^ -successor ^-^ referred to as the 
last successor of v. The tail ofv, tail (v), is the leaf reachable from v by last-successor relations. 
The tail of a leaf is itself. The tail ofT, tail (T), is the tail of its root. The head of a leaf u, 
head {u), is the ancestor of u with the largest height such that u is its tail. 
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Definition 4.2 (Valid ToC). An (n, d)-ToC T is valid if for all internal v and for each pair of 
s,t € Jn with (pCv (•s) = name (ug) and name (uf) share a common suffix of length height {v) — l, 
where Ug and ut, respectively, are the tails of the s''^ -successor and t*^ -successor of v. 








1. 







mil ml\ ml\ ml\ mu 



Figure 7: A valid (2, 2)-ToC T 



Definition 4.3 (Br for accessing T). Suppose T is a valid {n,d)-ToC. The input to Mq- is a 
point q from (JI„)°' (defining the name of a leaf u in T). Let h = height (head {u)). If u is the 
tail of T , i.e., h = d, then B7- = T. Otherwise, let vi = head (u) and let v be the parent of 
vi. Note that vi is the q^J^_f^-successor of v. Let Ti be the tree rooted at vi. As u ^ tail(?;), 



(pCvild-h) is defined and let T2 be the subtree rooted the 4>c^{qd-h} 
Br(q) = {h,(l)cA<ld-h),Ti,T2). 



\th 



successor of v. Then, 



We now define our final search problem Name-the-Tail, on a valid (n, d)-ToC. The search 
problem NT*^ is: Given a valid (n, d)-ToC T* accessible by find the name of its tail. We 
will prove Theorem 14.41 in Section [4.31 Below, we prove Theorem 14.51 to reduce NT"^ to ES'^. 



Theorem 4.4 (Complexity of NT'^) 



For all sufficiently large n, 
1 



n 



2 V2 • 24'=' 



Theorem 4.5 (From NT"' to ES'^). For alld>l, RQntW < RQes(4^ + 4)- 

Proof. We need to build a d-non-repeating string from a valid (n, ci)-ToC T. In fact, we will 
construct two strings SIT] and Q[T] over ^4^+4, each has length @{n'^) ■ d. S[T] starts with 
Sd and ends with J^(name (tail (T))) G while Q[T] starts with jr(name (tail (T))) and ends 
with ScL: where for p G Z'^ -^(p) = (2pi, .■■,2pd-i,2pd — 1) and s^^ G Z"' defined to be si = 1, 
and Sd = (2, 2, 1) for d> I. 

For any two strings 5i = ai-.-a^ and 5*2 = 61. ..64, let 5i o 5*2 = ai...akbi...bt. For d > 1, if 
Uk-d+i = bi for all 1 < i < d, then let Si S2 = ai...akbd+i..-bt. Given a string S over Z of 
length k- d, we write S as ui...Ufc with Uj G Z'^. Let insert^ {S, t) = ui o t o U2 o t...Ufc_i o t o u^. 

We use the following recursive procedure. Let r be the root of T. Assume Cr = ai...a2n+i- 
When d = 1, we set S[T] = 16i52---&2n+i and Q[T] = 62n+i---&2^il) where bi = 2ai — 1. When 
d > 2, 

1. let Ti be the subtree of T rooted at the a'^^-successor of r and let pi G (F„)'*^^ be the 
name of the tail of % given by % (not by T) . 
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2. for every odd i G [1 : 2n+l], set S'^ = insertd_i (^[Ti], 2ai) (which starts with s^-i and ends 
with T{pi)) and for every even i € [1 : 2n + 1] set S'^ = insertd_i {Q[Ti], 2aj) (which starts 
with:r(pj) and ends with Srf_i); S[T] = SrfOrf_iS'Jorf_i5^0rf_iS'^o^_i...Orf_iS'^^Orf_iS'^^^i; 

3. for every odd i € [1 : 2n + 1], set Q[ = insertrf_i {Q[Ti], 2ai) (which starts with ^(pi) and 
ends with s^-i) and for every even i S [1 : 2n + 1], set Q[ = insertrf_i {S\Ti\,2ai) (which 
starts with Sd-i and ends with J^(pj)); Q[T] = (2a2n+i) o Qgn+i °d^i Q'^n °d-i ■■■ °d-i 
Q2 °d-i Q'l ° Sd- 

The two strings for the example in Figure [7] above are: 

5^ = 21434547494^10910710510310112312912^1251276561169636183858789811 
Q[T] =81189878583816369611656712512111291231211031051071091011494745434121 

The correctness of our construction can be estabhshed using the next two lemmas. □ 

Lemma 4.6 (Non-Repeating). If T is a valid {n,d)-ToC, then both S[T] and Q[T] are d-non- 
repeating. 

Proof. We prove the lemma by induction on d. The base case when d = 1 is trivial. 

Assume d > 1 and also inductively that the statement is true for d — 1. Suppose for the 
sake of contradiction that S' = aia2...ad G ^4n+4 appears in SIT] more than once. Note that 
exactly one symbol in 5", say at, is odd. Let k [1 : d] he the following integer: t = d, then 
fc = 1; otherwise, k = t + 1. 

First, if Ofc = 2, then 5' appears in S[T] implies (ai, 02, a^) = s^^. But such S' only 
appears in S[T] once, which contradicts with the assumption. 

Otherwise, let S" G ^4^+4 be the string obtained by removing from S', then: if 0^/2 is 
odd, then S" appears in Q[7^^/2] more than once; otherwise, S" appears in 5[7^j./2] more than 
once, which contradicts with the inductive hypothesis. 

The proof for string Q[T] is similar. □ 

Lemma 4.7 (Asking Bt)- Suppose T is a valid (n, d)-ToC and S = S[T] and Q = Q[T]. For 

any u G Z4„+4, we can compute IB5'(u) and Bq(u) by querying B7- at most once. 

Proof. We need the following two propositions. Proposition 14. 91 can be proved by mathematical 
induction on d. 

Proposition 4.8 (Vectors not in S and Q). Let Vi = {2, 4, 4n + 4}'^^^ x {1, 3, 4n + 3} 

and Vk = {2, 4, 4n + 4}^-^ ^ {1, 3, 4n + 3} x {2, 4, 4n + 4}'^-'=+i for 2 < k < d. If 
u ^ U/^Vk then u neither appears in S nor in Q. 

Proposition 4.9 (All the same). Let T and T two valid {n, d)-ToCs. //u G UfcVfc and Ui = 1 
or Ui = 2 for some 1 < i < d, then Mg^'j-j{u) = Mg^q-ij^u) and Bqj7-](u) = Bqj7-/](u). 

We first consider two simple cases for which we don't even need to query B7-. 
1. When u ^ UfcVfc, by Proposition S^l B5[r](u) = Kq[t](u) = ("no", "no"); 
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2. When u G U^V^ and Uj = 1 or = 2 for some 1 < i < o?, by Proposition 14.91 we can 
compute B5(u) and Bq(u) from the vahd (n, c?)-tree in which every connector is generated 
by the identity permutation from {1, . . . , n} to {1, . . . , n}. 

Now we can assume u G U^f/fc where Ui = {4,6, ...,4n + A}'^^^ x {3,5, ...,4n + 3} and Uj. = 
{4,6...,4n + 4}'=-2 X {3, 5, 4n + 3} x {4, 6, 4n + 4}'^"'''+i for 2 < /c < d. First note that 
there is exactly one odd entry in u. If u G C/^ then let u' be the string obtained from u by A; — 1 
left-rotations. Not the last entry of u' is odd. Let q be the vector in (Jn)"^ where qi = u[/2 
for \ < i < d — 1 and qd = {u'^ + l)/2. We now prove a stronger statement which implies that 
B5'(u) and IBq(u) can be computed from Br(q)- 

For all q G (Jn)'^; we can determine B5(uj) and BQ(uj) from B7-(q), where is 
the vector in Uk obtained from J^{(l) by k — 1 right rotations, for 1 < k < d. 

If B7-(q) = T, the statement is clearly true. Otherwise, assuming M'j-{q) ^ T, we prove 
the statement by induction on d. The base case when d = 1 is trivial. For d > 2, let 
q' = {q2, Q3, Qd) and let v^. be the vector generated from .F(q') by /c — 1 right rotations, 
for 1 < A; < d — 1. Let T' be the subtree of T rooted the (;i-successor of the root of T. 
As B'7-/(q') is contained in Mr{<i), we can determine ^s[T']i'^i) and ^Q[T'](yi) for using our 
inductive hypothesis, from which, we will show below, we can determine B5(uj) and BQ(uj). 

We will only prove the case for B5(uj) when qi is even. All other cases are similar. 

Note that the first entry of Vj is not 2, so for all 1 < z < d— 1, ©^[^-/^(vj) 7^ ("no", a). Also, 
for i > 1 the last entry of Vj is even, so, Ms[T']{'^i) 7^ {(^i "no"). Therefore, for alH G [2 : d— 1], 
Bs{u,) = B5[r'](vi). For z = 1 or d, if B5[r'](vi) = ("no", "no"), thenB5(ui) = ("no", "no"); if 
B5[r'](vi) = (0,6), then Bs(ui) = (a,2gi), Ms{vid) = {2qi,b); if B5[r'](vi) = (a, "no"), letting 
the second component of Br(q) be r, then B5(ui) = (a, 2r) and B5(urf) = ("no", "no"). □ 

4.2 Knowledge Representation in Algorithms for NT'' and a Key Lemma 

An algorithm for NT'' tries to learn about the connectors in T* by repeatedly querying its 
leaves. To capture its intermediate knowledge about this T* , we introduce a notion of partial 
connectors. 

Let a = [o"(l), cr(A;)] be an array of distinct elements from {0, 1, ...n}. Then, a defines a 
string -S'o-(i) o ... o S'o-(fc), referred to as a connecting segment. Recall 5*0 = 2, S*! = 3 o 4, ...Sn = 
[2n + 1)0 (2n + 2). A partial connector over JI„ is then a set C of connecting segments such that 
each j G Jn is contained in exactly one segment in C and 2 is the first element of the segment 
containing it. If C has n + 1 segments, that is, C = {2, 3 o 4, (2n + 1) o (2n + 2)}, then C is 
called an empty connector. We say a connector C is consistent with a partial connector C if 
every segment in C is a substring of C. 

Let r[C] be the last symbol of the segment in C that starts with 2. Let L[C] and 
respectively, be the set of first and the last symbols of other segments in C. So, r[C] G F„ U {2}, 
L[C] C 0„, and R[C] C F„. Also, \ L[C] \ = \ R[C] \. If 2 / r[C], we use (/>c(2) to denote its right 
neighbor. Note that each s G Jn — L[C\ U R[C\ U {r[C],2} has two neighbors in C. If s is even, 
we will use (t)c{s) to denote its right neighbor and if s is odd, we use (t)c{s) to denote its left 
neighbor. 
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Initially, the knowledge of an algorithm for NT'^ can be viewed as a tree T of 
empty connectors. At each round, the algorithm chooses a query point q and asks 
for Mq-*{q), which may connect some segments in the partial connectors. So T is 
updated. The algorithm succeeds when every partial connector becomes a connector 
and T grows into T*. 

So, at intermediate steps, the knowledge of the algorithm can be expressed by a tree T of 
partial connectors. 

Definition 4.10 (Valid Tree of Partial Connectors). An {n, (i)-ToPC T is a tree Tn,d in which 
each internal node v is associated with a partial connector over JI„. 

T is a valid (n, (i)-ToPC if for each internal node v G Tn^d whose children are not leaves, 
its partial connector at v satisfies the following condition: For each pair s,t € Jn with 
</'c„(s) = t, the tree 7^ rooted at the s^'^ -successor Vg and the tree % rooted at the t^^ -successor 
vt of V are both valid ToCs, and name (tail [vs)) in Tg and name (tail {vt)) in Tt are the same. 

A valid (n, d)-ToC T* is consistent with a valid (n,(i)-ToPC T, denoted by T |= T*, if for 
every internal node, its connector in T* is consistent with its (partial) connector in T. 

A partial connector C is a (3 -partial connector for < /3 < 1 if the number of segments in 
C is at least (1 — /?)n + 1. To simplify our proof, we will relax our oracle B7-* to sometime 
provide more information to the algorithm than being asked so that the T it maintains always 
satisfies the conditions of the following definition: 

Definition 4.11 (Valid (ra, d, /3)-ToPC). A valid {n,d)-ToPCT is a valid (n, d, /3)-ToPC if its 
root has a (3-partial connector, Moreover, for each internal node v G Tn^d whose children are 
not leaves, if the partial connector C„ at v is a (3-partial connector, then it satisfies the following 
condition: The s^'^ -successor ofv, for each s G L[C] Ui2[C] U{r[C]}, has a ^-partial connector. 

Key to our analysis is Lemma 14.121 below, stating that every valid (n, d, /?)-ToPC has a 
large number of consistent valid (n, (i)-ToCs, and moreover, the names of the tails of these 
ToCs are nearly-uniformly distributed. Let J^[T] = {name (tail (T*)) | T ^ T*}. Also, for each 
p G (F„)'^, let iV[T,p] = \{T*\T \=T* and name (tail (T*)) = p}|. 

Lemma 4.12 (Key Lemma). For d>l and (3 G [0,24"'^], \T[T] \ > {{I- (3)nY for each valid 
{n,d,P)-ToPCT. Let ai{p) = 1. Then, for all pi,P2 G T[T], 

< -rri-r r < ad{(3), where ad[[3) = — — -rri —■, ford > 2. (1) 



adiP) - N[T,p2] - " {2{l-(3f-^ -lY'- 

Proof. When d = 1, let C be the only partial connector in T. Clearly, T[T] = R[C]. Thus, 
in this case the lemma is true. We will also use this case as the base of the induction below. 
When d> 2, let C be the partial connector of the root. For each k G J„, let 7^ be the subtree 
of the /c'^-successor of the root. Below, we will prove by induction on d that ([T|) and (**) 
J^[T] = U^.gj^[c](fco^[7^] ) are true for all d. Note that (**) and the first condition of Definition 
SH] imply that \J^[T] \ > ((1 - f3)n)'^. 

Let C = {10)^1)^2, ■■■,Ym} be the /3-partial connector at the root of T; assume Yq is the 
segment starting with 2. We use and ti, respectively, to denote the ending and starting 
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symbols oiYi. For each k G {tq, r^, ii, im }) let Tk denote the {n,d — l,/9)-ToPC at the 
fc^'^-successor of the root. For each pair € [0 : m] x [1 : m] with i ^ j, we define 

N[%,,p].N[Tt^,p]. 

Inductively, ^ and (**) hold for ah d' < d. As a result, we have \T[Tk] | > ((1 - j3)nY~^ for 
every k G {ro, ...rm,ti, ...tm}- Thus, 

i^[T,j n nTt,] I = im.] I + im,] i - u nz,] i > (2(1 - 13)^-' - 1)^'^-^ > 0, 

because /? < 24"°'. By the inductive hypothesis, we have Nij > 0, for all (i, j) G [0 : m] x [1 : m] 
with i ^ j- 

To show (**), it suffices to prove that A^[T, p] > if and only if p G ^keB.[C]i^ ° ^[^k] )• 
Clearly, N[T,p] = for p ^ ^keR[C]{^°^['^k] )• So, let us consider p G ^keR[c]{^^°^['^k] )• Since 
pi G R[C], WLOG, assume pi — ^Ve use to denote the set of permutations soSi...Sm— i 
over [0 : m — 1] with sq = 0. Then 

N[T,p] = Eso.i....™-i6-P ((riilLo^^s^^^+i) ■ Ns^-i,m- N[Tr^,{p2,P3,.:,Pd)]) ■ 

By the inductive hypothesis, every item in the summation above is positive. So A^[T, p] > 
and (**) holds for d. 

Next, to prove consider pi G T[T] and p2 G J^[T]. There are two basic cases. When 
Pi,i = P2,i) Eqn. ([H) follows directly from ([2]) and the inductive hypothesis. When pi^i ^ p2^i, 
without loss of generality, we assume pi^i = and p2,i = ^m-i- 

Let Vi denote the set of permutations over {0, 1, m — 2, m — 1} with sq = and V2 denote 
the set of permutations over {0, 1, ...,ni — 2,m} with sq = 0. For P = soSi...Sm-i G Vi , let 
n(P) be the permutation obtained from P by replacing m — 1 by m. Clearly 11 is a bijection 
from Vi to V2- We can write A^[T, pi] and A^[T, P2] as two summations: 

N[T,pi] = Epep, NiiP), and iV[T,p2] = ZpeV^ M^iP)), 

where Ni(P) and A^2(n(P)) are given by similar terms as in ([2]). 

We now prove for every P G Vi, {Ni{P)/N2(n{P)) < adijS). Let P = so^i-.-Sm-i where 
Sfc = m — 1 for some 1 < k < m — 1. k < m — 1, then we expand Ni{P) and A''2(n(P)) as: 

Nl{P) ^ iVsfe_i,m-l • Nm-l,sk+i ■ Ns^-um " N[%^ , {pi^2, Pl,3, ■■■,Pl,d)] 
N2{U{P)) ~ Ns,_„m ■ Nrn,s,+^ • iVs„_i,m-l " N[Tr,„^„ {p2,2, P2,3, ■.■,P2,d)] ' 

It then follows from the application of our inductive hypothesis to the straightforward expansion 
of terms Nij that iVi(P)/iV2(n(P)) < ad{l3). 

Similarly, we can establish the same bound for the case when k = m — 1. □ 

4.3 The Randomized Query Complexity of NT*^ 

By querying every leaf, one can solve any instance of NT'^ with n'^ queries. Below, we prove 
Theorem 14.41 by showing RQ^j(n) = (Q(n))'^. We first relax Mr* by extending it to (Jn)™' for 
m G [1 : d]. 
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Definition 4.13 (Relaxation of B-r*)- Suppose T* is a valid {n,d)-ToC and q E (Jn)"^- Let 
V be the node with name(f) = gi(?2---9m- Let q' = name (tail (f)) G (Jn)"^ {in tree T*). Then, 
Br*(q) =Br•(q')■ 



Query-and-Update(T, q), where q E {^nY 

: if T has complete information of q then return; 

1: if30<i<d-l:| R[Ci\ | = (1 - (id)n then 
2 : set m be the smallest of such i [m E [0 : d — 1]) 

3 : else set m = d 

4 : if m = then set T = T* { and / = 1 } 

5: else Update (T, {qi,q2, ...,qm),rn) 

Update(T, q, m), where q E (Jn)"* and 1 < m < d 

6 : fetch Br* (q) {set Am = Am + I, Bm [Am] = and Bm,k [Am] = } 

7 : if Br- (q) = T* then set T = T* { set Bm[Am] = 1 } 

8 : else [let d — m<h<d— 1 and r E Jn be the first and second components of Br* (q) ] 
9 : set ml = d — h — 1 

10 : 3 Yi, 12 G Cm''- {the ending symbol of Yi, the starting symbol of ^2 } = {'Zm'+ii 

11 : replace Yi and I2 in C^/ by the concatenation of Yi and I2 {set Bm,m'[Am] = 1 } 

12 : let T' and T" be the third and fourth components of Br* (q) 

13: replace the subtree of T rooted at Um'+i with T'; 

14 : replace the subtree of T rooted at the r-successor of Um' with T" 



Figure 8: 

Proof (Theorem 14. 4p . To apply Yao's Minimax Principle [32j, we consider the distribution V 
in which each valid (n, d)-ToC T* is chosen with the same probability. We will prove that the 
expected query complexity of any deterministic algorithm A for NT over V is in{n)f. Let 
Pd = 24-'^. 

Suppose, at a particular step, the current knowledge of A can be expressed by a valid 
(n, d, /3d)-ToPC T, which is clearly true initially, and A wants to query q E (Jn)'^- Let uq be 
the root of T and Ui be the node with name(ni) = qi...qi. Let Ci be the partial connector at 
Ui in T and % be the subtree of T of Uj. There are two cases (1) Vi E [0, d — 1], Ci is a partial 
connector and gj+i E L[Cj] Ui?[Cj] U {r[Ci]}. (2) otherwise. From the definition of Br*, we can 
show that in case (2), Br*(q) can be answered based on T only. So, WLOG, we assume A is 
smart and never asks unnecessary queries. 

In case (1), because T is a (n, d, /3d)-ToPC, Ci is a /J^-partial connector for all i E [0, d— 1]. 
Let h = height (head (q)). If h = d, then A gets T*. Otherwise, the knowledge gained by 
querying Br*(q) connects two segments in Cd-h-i and replaces the two involved subtrees 
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by the corresponding ones in B7-*(q). The resulting tree T, however, may no longer be a 
(n, d, /?rf)-ToPC, if ji?[Crf_/i_i]| = (1 — I3d)n before the query. We will relax Br* to provide 
A more information to ensure that the resulting T remains a valid (n, d, /3d)-ToPC. To this 
end, we consider two subcases: Case (l.a): if V i G [0 : d — 1], \R[Ci]\ > (1 — /?d)n, then A 
receives Br*(q) as it requested. Case (l.b): if 3 i € [0 : c? — 1] such that = (1 — /3d)n, 

then let m = min{i : |-R[Ci]| = (1 — Pd)n}. Let q' = {qi, ...,qm)- Instead of getting Br*(q), 
A gets MT*{q'). In this way, the resulting T remains a valid (n, d, /?(i)-ToPC. Details of the 
query-and-update procedure can be found in Figure El 

We introduce some "analysis variables" to aid our analysis. These variables include: (1) 
/ G {0, 1}: Initially, / = 0. If m = in case (l-b), then we set 1 = 1. (2) For each m G [1 : d]. 
Am G Z, and a set of binary sequences i3m[---] and 13m,k[---], V/c G [0 : m — 1]. Initially, Am = 0, 
and Bm, Sm,k are empty. Each time in case (l.b) when m > 0, we increase Am by 1; in case 
(l.a), we increase A^ by 1. To unify the discussion below, if we have case (l.a), let m = d and 
q' = q. If Br*(q') = T* , we set Bm[Am] = 1 and Bm,k[Am] = 0, V/c G [0 : m - 1]. Otherwise, if 
the first component of B7-*(q') is d — /, for / G [1 : m], then set Bm,i-i[Am] = l, Bm[Am] = 
and Bm,k[Am] = for all < A; 7^ / — 1 < m — 1. 

Let Md = Given a random valid (n, d)-ToC T*, if A stops before making M^, 

queries, let {I, Am,Bm,Bm,k} be the set of analysis variables assigned when A stops; otherwise, 
{/, Am,Bm, Bm,k} is assigned after A makes exactly M^, queries. Let Mi = (/3(in/2)*. We define 
a set of binary strings {Bm[^---Mm], Bm,k[^---Mm], l<m<d, 0<k<m — 1} from Bm and 
Bm,k- For every 1 < i < Mm, (I) Bm[i] = Bm[i] for i < nim{Am, Mm) and Bm[i] = for 
Am <i < Mm] (II) 0m,fc[«] = Bm,k['''] ^ ^ niin(^m,^m) and Bm,k[i] = Am < i < Mm- 

Let [A] denote that an event A is true. Let NOT- YET-FOUND (T*) be the event that A 
hasn't found the tail of T* after making queries. Let Bm, Bm,k, Bm and Bm,k denote the 
number of I's in Bm, Bm,k, Bm and Bm,k, respectively. Then, [NOT- YET-FOUND (T*)] if and 
only if [I = and Bm = 0,Vm G [1 : d]]. The theorem directly follows from Lemmas 14.141 
below. □ 

Lemma 4.14. Let A denote the following event, 



then (E.l) [A] implies [NOT- YET-FOUND (T)] and (E.2) Pr© [A] > 1/2. 

Proof (of Lemma l4.14p .' To prove (E.l), we use the following inequalities that follow from the 
definition of our analysis variables. 



1) < -5— Yl for all 1 < m < d - 1; and 2) 1=1 =^ ^ B.^ > (3dn. (2) 

Pd^ 11 -1 

i=m+l 1=1 

Recall that [NOT- YET-FOUND (T)] = [ / = and B„ = 0, Vm G [1 : d]]. 

To prove (E.l), it suffices to show that [A] ^ [/ = 0] and [A] =^ [Bm = 0, V m G [1 : d]]. 
We use [A] =^ [B] to denote if event A is true then event B is true. It follows immediately from 
the definitions of Bm and Bm, that if Am < Mm, then Bm = Bm- So, we first inductively prove 




and B 



m,m— 




d 



d 
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that [A] =^ [Ad~m ^ Mfi-mi'^ m ^ [0 : d — 1]]. The base case when m = is trivial, since 
is at most M^, the total number of queries. 

We now consider m > 1, and assume inductively, that Ai < Mi for all i G [d — m + 1 : d]. 
Consequently, for all i G [d — m + 1 : d] and j G [0, i — 1], = Bi and Bij = Bij. By Eqn. 
(I2|), we have 



A 



< 



E 



B 



i,d—'m 



< 



/^dW . /3rfn /3rfn 

i=a— m+l 



i=d—m+l i=d—m+l 

d / r, \ i-d+m-l 



j=a!— m+2 



n 



16 • Afj 

i—d+m—l 



i=d—m+2 



< Md-m ( ^ + 8 • y • 2 ) < Md_„. 



Thus, [A] =^ [Bm = 0, V m G [1 : d]]. Now we prove [A] implies [/ = 0]. 
Consider the partial connector C at the root. We have. 



S„ = 0, V m G [1 : and J2i=i Bm,o < Pdn =^ [\R[C] | > (1 - Pd)n] ^ [/ = 0] . 



So it suffices to show [A] implies [^^^=1 Bm,o < Pdn]. Assume [A], then 



j=m m=2 m=2 \ m=2 ^ / 



< Pdn. 



The first equation follows from [A] =^ [^d-m ^ Md-m,^iTT- £ [0 : d — 1]] and the first in- 
equality uses BfYi YTi—i ^ for all ui (£ [1 : (i]. Finally, to prove (E.2), 



B^ = 0,Bm,k < ^^^^,5m,m-i < M„,V m G [1 : d] , G [0 : m - 2] 



Prp[A] = Prv 

> 1 _ I ^ Prj, [:b^ > 0] + ^ ^ Pri, 



d m— 2 



\ m=l m=l k=l 

The last inequality follows from Lemma |4.18[ 



- 16 -M^ 



1 

> -. 

- 2 



□ 



As T is chosen randomly from valid (n, (i)-ToCs, and Sm.fc are random binary strings 
from a distribution defined by the deterministic algorithm A. To assist the analysis of these 
random binary strings, we introduce the following definition. 

Definition 4.15 (c-Biased Distributions). Suppose we have a probabilistic distribution over 
{0, 1}™. For every binary string S of length at most m, we define 



Us = [s' e{^,l}'^\S is a prefix o/ 5' }. 



For < c < 1, the distribution is said to be c-biased if we have Pr[Ui] < c and Pr[Usoi] < 
c • Pr[C/5] for every binary string S with 1 < |5| < m — 1. 
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As an important step in our analysis, we prove the following lemma. 

Lemma 4.16 (Always Biased). For all 1 < m < d, the distribution over 3^ is 2/n^-hiased. 
Similarly, for 2 < m < d and < k < m — 2, the distribution over Bm,k is 2 /n"^~^~'^ -biased. 

Proof. The lemma follows from Corollary 14.171 below of om' Key Lemma (j4.12p . □ 

Corollary 4.17. For d> 1 and (3 e [0,24"^^], let T be a valid {n,d,P)-ToPC and let integer 

N = J2peJ^[T] -^[^'P] ^6 number of consistent ToCs. For q G (Jn)™ where m G [1 : d], if 
tree T has no information on q, then 

1. {N*/N) < (2/n™) where N* = \{T'\ Br'(q) = N ^'}|; and 

2. {Nk/N) < {2/n'^^^^^) where for < k < m — 2, denotes the number of consistent 
ToCs T such that the first component ofMq-r{q) is d — k — 1. 

Proof. For each k e [0 : m - 1], let Wfc = {p G J^[7fc] C (F„)°'"'', where pi = Qk+u^i G [1 : 
m-k] }. Clearly, \ Wk \ < W^'"^. By Lemmailll for ah pi and p2 € T[T], N[T, pi]/N[T, pa] < 
ad{(3). Thus 

N* _ T.peWo^i'^^P] ^ adiP) ■ \Wo\ ^ ad{l3)n''-"' ^ 2 
N EperiT] N[T, p] " |.F[T] | " ((1 - /?)n)'^ " ' 

The third inequality uses Proposition lA.31 To prove the second statement, for G [0 : m—2], 
we consider any connector C* over that is consistent with and satisfies (pc* ((^fc+i) 7^ "no" . 
Assume (j)c*{qk+i) = We use T' to denote the subtree of T rooted at the r*'*-successor of 
Uk- Since T has no information of q, both Tk+i and T' are {n,d — k — 1, /3)-ToPCs. Then 

Epgiy,+inm+i]n^[r'] m^k+iM ■ N[r,p] ^ {aa_k-i{P)f ■ n''-"' ^ 2 



Epen%+i]nnr'] N[rk+i,p] ■ n[t', p] ^ (2(1 - pr-i^-^ - 1) • n^~>'-^ - n^-'^-i • 

□ 

Lemma 4.18. For all m G [1 : and k ^ [0 : m — 2], we have 

Pr^[Br^>0]<— and Pr^ [S^,, > ] < _. 

Proof. We will use the following fact: Let ^^^ivz) distribution over {0, 1}'" where each 

bit of the string is chosen independently and is equal to 1 with probability c. For all c-biased 
distribution over {0, 1}™, for any 1 < k < m, 

Prs^V"^ [S has at least A; I's] < Prs^vj^^^j [S has at least k I's] . 

By Lemma SHI Prv[Bm > 0] < 1 - (1 - 2n-™)*^™ < 4(/3d/2)™ < 1/2^2. The second 
inequality uses Propositions IA.2I and lA.H and the last inequality uses 

Pd = 24-"=^ and the fact 

m > 1. We can apply the Chernoff bound [9j and Lemma 14.161 to prove the second probability 
bound. □ 
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5 A Conjecture 



We conclude this paper with the following conjecture. 

Conjecture 1 (PLS to PPAD Conjecture). // PPAD is in P, then PLS is in P. 
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A Inequalities 

Proposition A.l. For all P>0, I - (3 < e~^ . 
Proposition A.2. For all Q < ^ <!/?>, 1 - /3 > 6"^^. 
Lemma A.S. For alld>l and p G [0,24"'^], ad{P) < e^-^^'""'/?. 
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Proof. We will use induction on d. The base case when d = 1 is trivial. We now consider the 
case when d > 2 and assuming inductively that the statement is true for all d — 1 . 
By Proposition IA.2t for any /3 G [0, 24"*^], we have 

(2(1- (3)^'^ -1^ > (2(e-2^)~-lj > (2(l-2/3(d-l)) -l) 

= (l - A(3{d -!))'> (e-8;3(d-l)^=^ ^ g-24/3(d-l) 

By the inductive hypothesis, we have 

where the last inequality follows from 14 • 24'^-2 + 24{d - 1) < 2 • 24'^-\ for all d>2. □ 
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